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INTRODUCTION 

The  goal  of  this  research  was  to  determine  how  patient  safety  and  the  avoidance  of 
medical  error  can  be  effectively  taught  to  student  nurses  in  a  simulated  setting.  Three 
strategies  were  compared:  a)  high  fidelity  (mannequin)  b)  standardized  patient  (actor)  and 
c)  video  platform  (virtual).  Both  the  subjects  and  the  research  assistants  were  blinded  to 
the  Dependent  Variable:  the  commission  of  an  error.  Subjects  were  randomized  to  each 
of  the  three  experiments  in  a  crossover  design.  In  each  of  the  four  semesters  of  the  study, 
one  group  served  as  a  control  and  were  randomized  to  a  one-time  experiment,  each 
semester  offered  one  of  the  three  experiments  as  the  control.  During  the  last  and  fourth 
semester,  all  subjects  were  randomized  to  a  one  time-experiment  and  all  three 
experiments  were  offered.  Medical  error  was  embedded  in  each  of  the  three  experiments; 
the  scenarios  included  distraction. 

BODY 


Senior  nursing  students  in  their  final  semester  were  recruited  to  participate  during 
their  “capstone”  semester.  As  one  of  the  largest  schools  of  nursing  in  the  state,  we  had 
access  to  over  200  senior  students.  The  students  were  asked  to  participate  by  faculty 
who  attended  a  class  with  the  permission  of  their  instructor  to  brief  the  students  on  the 
time  commitment,  logistics  and  provided  them  with  a  written  consent  to  participate.  Of 
the  students  who  were  asked  to  participate,  54  participated  (80%  female,  20%  male)  over 
the  four  semester  timeframe.  The  ages  of  the  participants  ranged  from  20-30  (mean  SD 
of  25  years).  Of  the  students  who  actually  participated  50%  had  experienced  25%  of  the 
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clinical  hours  in  simulation  as  a  student  and  50%  had  experienced  25%  of  the  clinical 
hours  in  only  two  (2)  clinical  rotations  (pediatrics  and  obstetrics) 

Once  consented,  subjects  arrived  to  the  lab  with  no  prior  knowledge  of  the 
experiment.  The  lab  was  designed  to  keep  the  subjects  separate  utilizing  a  construction 
method  with  exterior  halls  and  soundproofed  simulation  rooms.  Each  subject  spent  up  to 
15  minutes  on  the  pretest.  15  minutes  in  the  experiment  and  up  to  15  minutes  for  the  post 
test. 

Subjects  were  randomized  to  all  three  experiments  in  a  crossover  design  with  a 
one  month  “washout”.  A  consensus  of  experts  agreed  on  a  one-month  washout  based  on 
prior  experience  with  teaching/learning  strategies.  Each  of  the  four  semesters  included 
one  cohort  of  subjects  who  were  only  tested  one  time  in  a  controlled  experiment.  The 
controls  were  each  of  the  three  simulation  strategies  and  the  fust  cohort  received  a  one¬ 
time  experience  in  one  of  the  three  experiments. 

Research  Objective  # 1 :  To  determine  if  one  of  three  methods  or  a  combination  of 
simulation  instruction  provides  greater  mastery  in  patient  safety  instruction  for  pre 
licensure  students. 

Initial  analysis  showed  that  there  was  no  discernible  difference  in  performance 
across  semesters.  To  allow  for  more  statistically  meaningful  analysis,  groups  were 
aggregated  across  semesters  (Summer  2012,  Fall  2012,  Spring  2013)  based  on  treatment 
order.  Table  1  shows  the  treatment  order  for  each  group.  Table  2  shows  the  results  for 
the  average  score  on  the  evaluation  form  (or  virtual  reality  platform)  and  sample  size  n; 
the  percent  that  committed  medical  error;  and  the  percent  that  were  distracted  from  their 
task;  and  the  weighted  average  for  each  treatment  number  across  treatment  types.  There 
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were  no  distractions  for  the  virtual  reality  treatment. 


Table  1:  Treatment 

order  for  each  group 

Group 

lsl  Treatment 

2nd  Treatment 

3rd  Treatment 

A  (control  group) 

A"-''® 

B 

Standardized  patient 

C 

Standardized  patient 

D 

Standardized  patient 

Virtual  reality 

Table  2:  Results  for  each  group  and  each  treatment,  in  chronological  order 


Group 

Treatment  1 

Avg  %  % 

Score  (n)  Med 
Error 

% 

Distracted 

Treatment 
Avg  % 
Score  (n) 

2 

% 

Med 

Error 

% 

Distracted 

Treatment  3 

Avg  %  % 

Score  (n)  Med 
Error 

% 

Distracted 

B 

50%  (8) 

38% 

0% 

80%  (3) 

0% 

n/a 

70%  (5) 

40% 

0% 

C 

68%  (10) 

9% 

n/a 

33%  (6) 

83% 

17% 

61%  (9) 

33% 

33% 

D 

44%  (8) 

38% 

50% 

50%  (5) 

60% 

40% 

73%  (6) 

17% 

n/a 

Overall 

55%  (26) 

26% 

25% 

49%  (14) 

57% 

27% 

67%  (20) 

30% 

21% 

There  appears  to  be  either  no  change  or  an  improvement  in  participant  score 
between  treatments  1  and  3;  however,  there  may  be  an  increase  in  medical  error.  There  is 
not  enough  evidence  to  conclude  there  is  a  statistically  significant  difference  overall.  The 


largest  apparent  difference,  between  Group  D’s  first  and  third  treatment  scores,  falls  short 


at  the  a  =  0.05  level  (one-tailed  p  =  0.08).  We  will  use  the  a  =  0.05  significance  level 
throughout  this  report  unless  otherwise  noted. 


Research  Objective  #2:  To  determine  if  the  sequence  of  three  methods  of  simulation 
instruction  predicts  mastery  of  patient  safety  instruction  for  pre-licensure  students. 

Table  3  shows  the  results  for  each  group  and  each  treatment,  sorted  by  treatment. 
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Table  3:  Results  for  each  group  and  each  treatment,  grou] 

oed  by  treatment 

Group 

Standardized  Patient 

Virtual  Reality 

High  Fidelity 

Avg  % 

% 

% 

Avg  % 

% 

% 

Avg  % 

% 

% 

Score (n) 

Med 

Distracted 

Score  (n) 

Med 

Distracted 

Score (n) 

Med 

Distracted 

Error 

Error 

Error 

B 

50%  (8) 

38% 

0% 

80%  (3) 

0% 

70%  (5) 

40% 

0% 

C 

61%  (9) 

33% 

33% 

68%  (10) 

9% 

33%  (6) 

83% 

17% 

D 

50%  (5) 

60% 

40% 

73%  (6) 

17% 

44%  (8) 

38% 

50% 

Overall 

55%  (22) 

41% 

23% 

71%  (19) 

10% 

47%  (19) 

53% 

26% 

The  largest  difference  in  average  score  is  between  high  fidelity  and  virtual  reality. 
The  hypothesis  that  the  average  score  for  virtual  reality  >  average  score  for  high  fidelity 
is  statistically  significance  with  the  one-tailed  p  =  0.026. 

Medical  error  appears  to  be  more  common  in  the  standardized  patient 
and  high  fidelity  environments  than  in  the  virtual  reality  environment.  Both  the 
difference  between  virtual  reality  and  standardized  patient;  and  between  virtual  reality 
and  high  fidelity  are  statistically  significant,  two-tailed  p  =  0.03  and  0.004,  respectively. 

Because  participant  results  for  specific  treatments  are  being  combined  across 
treatment  numbers,  the  comparisons  above  may  be  obscuring  actual  differences,  or 
conflating  them  with  other  factors.  We  next  examine  the  differences  in  treatments  using 
the  control  groups  and  only  observations  from  the  first  treatment  for  each  group. 

Table  4  summarizes  the  results  for  all  participants,  including  control  groups, 
being  exposed  to  a  treatment  for  the  first  time,  across  all  semesters. 
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Table  4:  Results  for  each  treatment  across  control  groups  and  first 
treatments  for  all  groups,  across  all  semesters. 


Standardized  Patient 

Avg  %  %  % 

Score  (n)  Med  Distracted 

Error 

Virtual  Reality 

Avg  %  %  % 

Score  (n)  Med  Distracted 

Error 

High  Fidelity 

Avg  %  %  % 

Score  (n)  Med  Distracted 

Error 

Overall 

50%  (13)  38%  31% 

71%  (18)  6% 

42%  (13)  46%  8% 

The  results  closely  mirror  those  that  compared  all  treatments  from  Groups  B-D. 
The  order  in  which  treatments  are  administered  seems  to  have  less  of  an  impact  than  the 
treatment  itself. 

The  difference  in  average  score  between  virtual  reality  and  high  fidelity  is 
statistically  significant,  two-tailed  p  =  0.04.  No  other  differences  in  scores  are  significant 
(p  =  0.67  for  standardized  patient  and  high  fidelity;  p  =  0. 13  for  standardized  patient  and 
virtual  reality). 

The  possible  difference  in  medical  error  between  standardized  patient  and  high 
fidelity  is  not  statistically  significant  (p  =  0.71).  The  difference  in  the  percent  distracted 
between  standardized  patient  and  high  fidelity  is  also  not  statistically  significant  (p  = 
0.15). 


Overall,  25  instances  of  medical  error  occurred  across  a  total  74 
observations. 
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Research  Objective  # 3 :  To  determine  if  prior  exposure  during  training  simulations 
can  predict  how  students  will  perform  relative  to  non-participants  on  a  final 
simulation. 

The  subjects  were  chosen  from  a  population  of  last  semester  Senior  nursing 
students  over  a  two  year  period.  The  first  two  semester  subjects  were  exposed  to 
25%  of  their  clinical  training  hours  in  simulation  across  two  disciplines  (pediatrics 
and  obstetrics).  The  last  two  semester  subjects  were  exposed  to  25%  of  their 
clinical  training  hours  ACROSS  their  entire  curriculum.  All  subjects  are  required  to 
take  a  Final  comprehensive  exam  as  part  of  their  graduation  requirements. 

The  Health  Education  System  Incorporated  (HESI)  Summary  Reports  provide  content 
area  scores  that  can  be  used  to  evaluate  curricular  strengths  and  weaknesses.  Estimated 
reliability  of  the  HESI  demonstrates  coefficients  (KR-20)  of  0.940  (Morrison  et  al.  2004) 
Evidence  of  convergent  validity  was  obtained  by  comparing  HESI  exam  scores  to  other 
measures  of  the  same  constructs.  In  three  as-yet  unpublished  studies,  associate  degree 
nursing  (ADN)  and  bachelor  of  science  in  nursing  (BSN)  faculties  that  use  HESI  exams 
provided  evidence  of  convergent  validity  for  these  exams  by  correlating  students’  HESI 
exam  scores  with  their  final  course  grades  and  cumulative  grade  point  averages  (GPAs). 
The  correlations  were  statistically  significant  (P  <  .01 .) 

There  is  no  statistically  significant  difference  between  HESI  scores  from  Spring 
2012  through  Summer  2013.  The  difference  in  score  between  the  highest  and  lowest 
average  is  91  points,  between  the  highest  and  lowest  medians  is  97  points,  on  a  scale  of  0 


to  1600. 
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The  following  areas  (Table  5)  had  spreads  of  150  points  or  more.  It  was  not 
possible  to  conduct  significance  tests  on  the  individual  areas  because  of  lack  of  standard 
deviations  in  the  summary  data  provided. 

Table  5  HESI  Subcategories 

o  N1  -  Assessment  (A  =  178):  max  =  Spl2,  min  =  Sp  1 3 
o  N3  -  Planning  (A  -  155):  max  -  Sul 2,  min  =  Sp  1 3 
o  Cl  -  Safe  Environment  (A  =  150):  max  =  Sul 2,  min  =  Fa  12 
o  C2  -  Management  of  Care  (A  =  170):  max  =  Sul  2,  min  =  Spl3 
o  C3  -  Safety  and  Infection  Control:  max  =  Sul2,  min  =  Fal2 
o  C4  -  Health  Promotion  &  Maintenance  (A  =  149):  max  =  Sul 3,  min  = 

Sp  1 3 

o  CIO  -  Physiological  Adaptation  (A  =  177):  max  =  Sul 3,  min  =  Sp  1 3 

Research  Objective  ft 4 :  To  design  a  rubric/model  for  safety  instruction  capable  of 
stratifying  average  and  exceptional  performance . 

We  were  unable  to  achieve  this  objective  during  the  two-year  study.  We  experimented 
with  adapting  the  Lasater  Inventory  form  (Lasater,  2007) ,  but  this  tool  depends 
significantly  on  the  debriefing  phase  of  any  given  simulation  exercise  and  due  to  the  need 
to  protect  the  dependent  variable,  none  of  our  subjects  were  debriefed  (Appendix  D).  We 
also  experimented  with  an  observational  tool  (checklist)  in  which  specific  tasks  were 
expected  and  then  evaluated.  This  form  served  as  the  basis  for  one  of  our  evaluation 
tools,  but  we  did  not  achieve  the  statistical  power  to  truly  develop  this  checklist. 
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KEY  RESEARCH  ACCOMPLISHMENTS 

•  Three  simulation  experiments  were  compared  in  classic  crossover  study.  To  our 
knowledge,  this  has  not  been  done  before. 

•  A  video  (virtual  platform)  was  developed  in  which  actual  actors  were  filmed  to 
give  a  more  realistic  approach  to  the  experiment.  Most  studies  utilize  computer- 
generated  avatars  that,  in  this  author’s  opinion,  appeal  more  to  the  “gaming” 
aspect  of  simulation  rather  than  a  “reality”  approach. 


•  The  Dependent  Variable  was  blinded  to  both  the  subjects  and  the  Research 
Assistants  who  were  themselves  chosen  across  a  Liberal  Arts  campus 
SPECIFICALLY  because  they  did  not  have  a  medical  background.  We  believe 
this  lends  more  credibility  to  observation  without  bias. 


REPORTABLE  OUTCOMES 

•  Mid-study  report  was  submitted,  accepted  and  presented  to  a  breakout  session 
audience  at  the  International  European  Simulation  Society  (SESAM)  in  Paris, 
France,  January  2013.  Appendix  A 

•  End  of  study  summary  was  submitted,  accepted  and  presented  to  a  plenary  session 
at  the  Magic  in  Teaching  conference  (Irvine,  California  October  2013). 

Appendix  B 

•  A  final  article  is  currently  under  development  (first  draft  Appendix  C)  for 
submission  to  the  Simulation  in  Healthcare  journal,  an  international  multi¬ 
discipline  journal  with  a  high  Impact  Factor  (1.64) 

•  Results  of  the  study  will  be  more  formalized  and  submitted  to  the  International 
Medical  Simulation  in  Healthcare  (American)  conference  in  2014. 

•  Educational  strategies  developed  in  this  study  will  be  utilized  in  an  Inter 
professional  Education  Symposium  at  the  American  University,  Beirut,  Lebanon 
in  June,  2014. 
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CONCLUSION: 

Of  the  three  treatments,  the  virtual  reality  scenario  had  the  lowest  incidence  of 
medical  error,  especially  compared  to  the  high  fidelity  simulation.  There  are  two  possible 
explanations  for  this.  The  first  is  that  the  current  generation  of  students,  the  Millennials, 
is  very  comfortable  with  and  adept  at  technology,  which  inherently  leads  to  higher 
performance.  Millennials  are  defined  as  those  individuals  who  were  born  in  the  time 
period  of  the  early  1980’s  to  the  early  2000’s.  The  second  explanation  is  that  the  virtual 
reality  simulation  requires  only  ordinary  learning,  not  transference  of  content  and  skills 
(Cook  et  al,  2012) .  In  other  words,  participants  in  the  virtual  reality  simulation  are 
showing  “Understanding”  in  Bloom’s  Revised  Taxonomy,  whereas  the  other  two 
simulations  require  “Applying”  of  knowledge  and  skills. 

Given  the  limited  sample  sizes,  it  is  not  possible  to  draw  strong  conclusions  about 
the  efficacy  of  high  fidelity  versus  standardized  patients.  Standardized  patient  scores  and 
medical  error  rates  are  higher  than  those  for  high  fidelity,  but  the  percent  distracted  are 
lower. 

We  argue  that  virtual  reality  simulations  would  be  a  good  tool  during  earlier 
education  stages,  as  students  are  learning  fundamental  concepts.  After  they  have  achieved 
understanding  and  are  able  to  recognize  good  practice,  high  fidelity  or  standardized 
patient  simulations  can  be  employed  to  assist  in  knowledge  and  skill  transference  and 


assessment. 
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With  respect  to  the  efficacy  of  ordering  of  treatments  it  is  not  possible  to  discern  any 
effects  of  the  ordering  of  treatments.  It  may  be  that  sample  sizes  are  too  small  or  that  the 
ordering  of  treatments  is  less  important  than  the  actual  type  of  treatment. 

Several  limitation  and  challenges  were  encountered  during  this  study.  Due  to 
the  student’s  class  schedule,  we  had  several  “no-shows”  on  occasion  and  even  after 
attempting  to  contact  them  to  reschedule,  we  met  resistance.  The  longitudinal  design 
(three  experiment  times  over  three  months)  was  on  first  notion  a  strong  methodology  as 
each  subject  could  serve  as  their  own  control,  yet  the  “drop  off’  rate  presented  a  problem 
of  statistical  power. 

The  goal  of  this  study  was  to  examine  the  ability  to  recognize  an  embedded 
medication  error  in  three  types  of  simulation.  Tables  1  and  2,  which  organizes  the  data  in 
terms  of  the  cycle  of  treatment,  yields  little  to  no  statistical  significance.  The  data 
therefore  suggest  that  despite  completing  a  given  previous  treatment,  the  nursing  students 
performed  equally  well  in  their  next  treatment  in  comparison  to  other  students 
undergoing  the  same  treatment. 

Table  3  offers  more  statistical  evidence  that  virtual  platforms  produce  higher 
average  scores  than  both  high  fidelity  and  standardized  patient  treatments.  With  an 
average  score  across  all  three  groups  of  71%,  virtual  platforms  surpass  the  average  scores 
of  55%  for  standardized  patient  and  47%  for  high  fidelity.  Also,  medical  error  seems  to 
be  the  lowest  with  virtual  platforms  with  an  average  rating  of  10%,  while  high  fidelity 
and  standardized  patient  treatments  yielded  55%  and  47%  respectively.  In  general,  these 
data  suggest  that  for  whatever  reason,  students  performed  better  in  a  virtual,  instead  of 
hands-on,  and  interpersonal  forum. 
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Table  4  collates  the  control  groups,  which  were  randomized  to  a  single  treatment 
and  not  asked  to  return  for  following  treatments,  and  the  first  treatments  of  groups  B,  C 
and  D.  Data  show  that  without  any  previous  exposure  and  no  proceeding  exposure  to  the 
treatments,  students  who  underwent  virtual  treatment  derived  a  higher  average  score  than 
both  high  fidelity  and  standardized  patient.  Virtual  treatments  also  yielded  considerably 
lower  medical  error  percentages.  This  suggests  with  the  given  student  demographic, 
virtual  platforms  are  more  conducive  for  current  students  than  both  high  fidelity  and 
standardized  patient  methods. 

A  reported  44,000  to  98,000  Americans  die  annually  as  a  result  of  medical 
(Benner  et  al  2002)  error.  With  this  knowledge,  it  is  imperative  to  not  only  continue  the 
education  of  health  professionals,  but  to  also  encourage  active,  critical  discussion  of 
current  educational  systems  in  healthcare.  It  is  clear  from  the  data  presented  in  this  study 
that  students  undergoing  what  is  considered  standard  nursing  education,  are  presenting 
low  capability  in  scenarios  requiring  active  application  of  their  knowledge  and  skills  (i.e. 
Standardized  Patient  &  High  Fidelity). 

It  can  be  said  that  today’s  generation,  in  general,  has  a  markedly  distinct 
upbringing  in  the  age  of  technology.  Therefore,  we  can  expect  students’  performances  in 
virtual  platforms,  as  opposed  to  those  requiring  active  application,  to  be  better.  However, 
healthcare,  as  also  tiue  in  the  military,  is  not  a  business  of  passiveness,  but  a  business 
of  active  practice.  So  the  question  must  be  asked  as  to  how  can  today’s  healthcare  (or 
military)  educational  system  confront  this  issue  presented  by  students  of  the  age  of 
technology.  As  this  study  shows,  although  limited  in  subjects  and  therefore  conclusions, 
the  use  of  progressive  methods  of  education,  such  as  high  fidelity  mannequins  and 


12 


technology.  As  this  study  shows,  although  limited  in  subjects  and  therefore  conclusions, 
the  use  of  progressive  methods  of  education,  such  as  high  fidelity  mannequins  and 
standardized  patients,  can  be  utilized  to  help  reduce  medical  risk,  and  improve  future 
healthcare. 

Although  conclusions  point  towards  virtual/computer  based  simulation  as  being 
the  best  methodology  for  medication  error  recognition,  we  wonder  if  the  age  of  the 
subjects  (~20  years)  accounts  for  a  greater  comfort  with  technology  and  we  wonder  why 
the  standardized  patients  demonstrated  the  greatest  challenge  for  this  group  of  subjects. 

In  a  careful  systematic  review  and  meta-analysis,  Smithberger  and  colleagues  (2012) 
compared  technology-enhanced  simulation  versus  other  instructional  methods;  they 
concluded  that  standardized  patients  and  real  patients  had  similar  effects  for  all  outcomes 
except  process  measures  of  skills.  Since  the  accuracy  of  appropriate  dose  and  delivery  of 
medication  is  a  complicated  skill,  one  might  conclude  that  our  findings  are  congruent. 

Gaba  (2012)  maintains  that  we  need  to  mobilize  larger  resources  to  provide  more 
definitive  answers  to  the  “big  questions  about  simulation”  (p.27).  We  are  grateful  to  the 
Department  of  Defense  who  provided  important  resources  to  advance  our  understanding 
of  how  different  simulation  strategies  serve  to  educate  and  train  novice  learners. 
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Abstract 

Healthcare  simulation  education  can  contribute  to  students  understanding  of  the  significance 
of  patient  safety,  specifically  medication  error  recognition.  To  determine  how  patient  safety 
and  the  avoidance  of  medication  error  can  be  taught  effectively  to  student  nurses  in  a  simulated 
setting,  we  designed  a  study  to  compare  three  simulation  strategies:  virtual  (computer- 
based),  standardized  patient  and  a  high-fidelity  mannequin.  Our  study  examined  the  ability  to 
recognize  an  embedded  medication  error  in  all  three  simulation  exercises.  The  data  included 
55  senior  nursing  students  from  a  baccalaureate  program  over  four  semesters.  Results  showed 
that  students  did  best  in  recognizing  medication  error  with  the  video  platform.  There  was  a 
correlation  between  the  students  who  had  experienced  25%  of  their  curriculum  practice  hours 
in  simulation  and  those  who  did  not.  Simulation  is  an  excellent  methodology  to  teach  students 
medication  recognition;  the  exact  medium  of  simulation  depends  on  the  age  of  the  students  and 
the  types  of  simulation  available  in  the  lab. 

Key  words:  simulation,  medication  error,  high-fidelity,  standardized  patient,  video 
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Background  and  Introduction 

Administering  medications  is  a  complex  task.  Patients  depend  upon  the  knowledge 
and  expertise  of  those  who  order  medications  and  those  who  administer  them.  Administration 
of  medications  in  a  hospital  setting  is  a  daily  occurrence;  every  nurse  administers  at  least  one 
medication  for  every  patient,  every  day  i. 

An  Institute  of  Medicine  (IOM)  report  concluded  that  at  least  1.5  million  preventable 
medication  errors  occur  each  year  in  the  United  States  (not  including  errors  of  omission)  and  on 
average  a  hospitalized  patient  is  subjected  to  more  than  one  medication  error  each  day  !. 

Educating  nursing  students  on  the  importance  of  safe  medication  administration  before 
they  are  employed  as  staff  nurses  is  imperative  and  simulation  plays  a  vital  role  in  this  education. 
There  is  a  strong  consensus  that  collaborative  practice  between  physician  and  nurse  should  result 
in  a  concert  of  the  right  patient,  ding,  dose,  route,  and  time.  3,  and  documentation.  4  This  is  not 
an  error  proof  strategy. 

Simulation  is  an  innovative  teaching  method  that  is  being  utilized  in  healthcare 
education,  and  is  a  proven  teaching  strategy.  Ziv  and  colleagues  5  suggest  that  patients  are 
“not  commodities  to  be  used  as  conveniences  of  training”;  clinical  educators  in  both  Medicine 
and  Nursing  are  tasked  with  developing  novel  strategies  to  educate  the  novice  learner  while 
protecting  patient  safety.  While  many  simulation  programs  have  proliferated  across  the  country 
and  globally,  we  do  not  yet  fully  understand  the  dose,  frequency  or  appropriate  amount  of 
simulation  that  is  appropriate  to  replace  or  enhance  the  traditional  model  of  “guild”  learning 


seen  in  traditional  clinical  education. 
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With  the  increased  sophistication  of  simulation  equipment,  and  the  growth  of  simulation 
centers  and  research  programs,  curriculum  development  in  simulation-based  education  has 
become  a  priority.  Gordon  et  al  suggest  that  if  simulated  cases  can  recreate  the  cognitive 
dynamics  of  real  encounters,  then  important  educational  moments  can  be  controlled  and 
efficiently  replicated  in  a  safe  environment. 

In  current  healthcare  settings,  the  opportunity  to  learn  is  restricted  by:  a)  the  availability 
of  clinical  learning  opportunity  b)  the  competition  among  different  levels  of  education  (doctors, 
nurses,  paramedics)  to  learn  in  situ  and  c)  the  financial  and  emotional  cost  (both  to  patient  and 
health  care  providers)  of  medical  error  on  the  part  of  novice  learners.  Patient  safety  concerns 
have  shaped  the  way  in  which  students  can  interact  with  patients  at  the  bedside,  and  the  way  in 
which  educators  now  view  the  “clinical  learning  lab”.  Ziv  et  al 4  take  the  position  that  the  use  of 
simulation,  wherever  feasible,  conveys  a  critical  educational  and  ethical  message  to  all:  patients 
are  to  be  protected  whenever  possible  and  they  are  not  commodities  to  be  used  as  conveniences 
of  training. 

The  situation  now  exists,  that  it  is  not  if  simulated  learning  is  effective,  but  when  to  use 
it,  how  to  do  it  and  how  to  evaluate  its  impact.  Weinger  6offers  a  conceptual  framework  to  guide 
simulation  research  by  incorporating  past  successful  research  models  from 
pharmacology.  Recent  work  by  Smithberger  et  al  7  compared  the  effectiveness  of  three  learning 
strategies:  simulation-based,  problem-based  and  standardized  patients  in  pharmacy  doctoral 
students;  this  appears  to  be  one  of  the  first  attempts  study  different  educational  approaches  in  a 
randomized  study. 
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Our  study  compares  one  simulation  format  with  another  using  different  levels  of  fidelity, 
different  combinations  of  simulation  techniques  and  different  instructional  techniques  as  a  way 
to  determine  “dose-effect,”  “dose  timing”  and  “drug-drug  relationships.” 

Continuing  with  the  notion  of  a  pharmaceutically-based  model,  crossover  studies  achieve 
clarity  as  each  subject  serves  as  his  or  her  own  “control.”  Nearly  all  crossover  designs 
have  "balance,"  which  means  that  all  subjects  should  receive  the  same  number  of 
treatments  and  that  all  subjects  participate  for  the  same  number  of  periods.  In  most 
crossover  trials,  in  fact,  each  subject  receives  all  treatments.  Adapting  Weinger’s  model 
using  crossover  methodology  may  inform  and  guide  a  research  agenda  that  advances  the 
question:  which  simulation  strategy  best  achieves  a  given  outcome? 

This  research  attempts  to  explore  patient  safety  as  an  outcome  (referred  to  here  loosely  as 
the  dependent  variable)  when  different  simulation  strategies  (high  fidelity,  standardized 
patients  and  virtual  simulation)  are  presented  (independent  variable)  to  the  novice  learner, 

Spross  and  Baggerly  shave  identified  key  competencies  in  several  domains  of  healthcare 
practice.  Working  within  these  domains,  systematic  and  human  factor  errors  will  be  embedded 
into  the  case  scenarios  that  are  assigned  to  three  possible  experimental  situations.  Errors 
were  chosen  to  encompass  the  three  major  categories  of  human  operator  failure  as  defined  by 
Rasmussen:  10 

a)  skill-based  errors:  errors  that  occur  during  “routine”  task 

b)  rule-based  error:  failure  to  follow  protocol 

c)  knowledge  error:  lack  of  or  inappropriate  application  of  knowledge 

This  Department  of  Defense  (DOD)  grant  funded  study  was  conducted  over  four 
semesters  specifically  addressing  medication  error  recognition  with  senior  nursing  students  in  a 
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baccalaureate  musing  program  at  a  private  university  in  San  Francisco,  California.  The  study 
was  designed  to  determine  how  patient  safety  and  the  avoidance  of  medical  error  can  be  taught 
effectively  to  student  nurses  in  a  simulated  setting.  The  study  investigated  which  simulation 
methodology  worked  best  in  medication  error  recognition:  virtual  (video  platform),  high-fidelity 
simulation  (mannequin)  or  standardized  patient  (actor). 

METHODS 

Design 

A  potential  medication  error  was  embedded  into  each  of  the  three  simulation  scenarios 
written  by  the  design  team.  The  content  of  the  scenarios  was  validated  by  three  (3)  experts 

The  medication  orders  were  embedded  in  a  series  of  “tasks”  and  “distractions”  that 
included  assessment  and  vital  signs.  All  subjects  were  randomized  to  all  three  experiments  in 
a  crossover  design  with  a  one-month  “washout,”  The  washout  period  was  determined  by  the 
content  experts  to  be  sufficient  for  subjects  to  “forget”  the  prior  experiment.  Each  semester 
(4  total)  included  one  cohort  of  subjects  who  were  only  tested  one  time  in  a  “controlled” 
experiment;  the  controls  were  each  of  the  three  simulation  strategies  and  the  last  cohort  received 
a  one-time  experience  in  each  of  the  three  experiments.  The  study  utilized  a  randomized, 
crossover  double-blind  design. 

Subjects  were  consented  to  the  study  as  “participating  in  a  study  comparing  simulation 
strategies”;  they  did  not  know  the  dependent  variable  (medication  error).  The  Research 
Assistants  (RA)  were  recruited  from  a  pool  of  undergraduate  students  across  a  liberal  arts 
campus  with  nursing  students  excluded  in  order  to  achieve  a  “naive”  pool  of  RA’s.  The  RA’s 
were  oriented  to  the  study  design  but  were  not  informed  of  the  dependent  variable  (medication 
error).  None  of  the  faculty  investigators  participated  in  the  data  collection. 
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Subjects  completed  a  pre  test  that  measured  the  cognitive  domain;  tire  tests  were  written 
and  validated  by  three  (3)  content  experts  and  were  tested  on  the  same  group  of  eleven  (11) 
participants  prior  to  beginning  the  study.  Subjects  were  introduced  to  each  of  the  three  (3) 
experiments  and  were  given  fifteen  (15)  minutes  to  complete  the  assignment.  Each  simulation 
was  stopped  at:  a)  fifteen  minute  mark  or  b)  when  the  student  discovered  the  potential 
medication  error  and  reported  it  to  someone. 

The  mannequin  (high  fidelity)  experiment  was  an  adult  patient  who  had  undergone 
abdominal  surgery  and  was  complaining  of  pain  and  hunger.  The  medication  order  was  for  100 
mg  of  Lasix  I  VP;  which  exceeded  the  appropriate  dose.  A  telephone  was  available  to  call  the 
physician. 

The  Standardized  Patient  (SP)  experiment  included  an  actor  who  had  a  long-standing 
history  of  asthma  and  had  multiple  complaints  throughout  the  time  period.  Prednisone  was 
ordered,  but  the  patient  stated  that  he  “could  not  swallow  pills”.  A  pill  crusher  was  available  in 
the  patient’s  medication  tray  along  with  the  Prednisone  tablets.  A  syrup  of  Prednisolone  was 
also  available.  The  subjects  were  to  decide  which  medication  was  appropriate.  A  telephone  was 
available  to  call  the  physician.  Both  the  high-fidelity  and  standardized  patient  experiments  were 
videotaped. 

The  virtual  (computer-based)  simulation  was  designed  by  three  content  experts  and 
consisted  of  a  videotaped  sequence  in  which  the  subjects  were  required  to  then  make  a  “correct” 
choice  of  one  of  three  videotaped  approaches.  The  virtual  platform  was  housed  on  a  Blackboard 
™  site,  one  that  each  student  had  familiarity  and  login  access.  There  were  five  video-questions; 
the  answers  could  be  accessed  by  the  faculty  investigators. 
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Participants  were  classified  as  to  whether  they:  a)  committed  a  medical  error  and  b) 
whether  they  were  distracted  from  the  important  task  they  were  to  complete.  Medical  error  was 
defined  as  the  wrong  dose,  the  wrong  medication,  inappropriate  protocol  or  being  distracted 
during  the  allotted  time. 

Evaluation  tools 
Materials 

Several  evaluation  instruments  were  used  in  study  and  included: 

a)  a  ten  question  pre/post  exam  (cognitive  measure) 

b)  A  self  report  of  satisfaction 

c)  Performance  Checklist  (direct  observation) 

d)  The  Health  Education  Systems,  Incorporated  (HESI)  (a  pre-board  exam) 

The  knowledge  pretest  was  administered  when  the  subject  arrived  at  the  laboratory  for  their 
study  experience  and  immediately  after  the  simulation.  The  10-item  pre  and  posttest  was 
piloted  with  one  summer  group  of  senior  students  prior  to  the  beginning  of  the  study.  The 
test  showed  some  issues  with  repetitive  questions  and  was  manipulated  from  a  13  questions 
test  to  a  10  question  test.  Every  semester  showed  a  strong,  consistent  item  analysis  (point-Bi- 
serial). 

The  satisfaction  survey  was  given  to  the  participants  after  all  three  simulation 
variations  were  completed  by  the  student  at  the  end  of  their  study  experience.  This  29 
item  survey  allowed  the  participant  to  self-report  on  their  overall  learning  effectiveness  of 
the  simulation  experiences  and  self-confidence  in  error  recognition  and  treatment. 

To  assist  the  observers  who  viewed  the  participant’s  video  performance,  a  key 
competencies  checklist  was  developed  by  two  clinical  experts  who  study  medication  errors.  The 
sequential  checklist  was  evaluated  for  satisfactory  content  validity  by  3  experts. 
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The  HESI  Summary  Reports  provide  content  area  scores  that  can  be  used  to  evaluate 
curricular  strengths  and  weaknesses.  Estimated  reliability  of  the  HESI  demonstrates  coefficients 
(KR-20)  of  0.940.  Evidence  of  convergent  validity  was  obtained  by  comparing  HESI  exam 
scores  to  other  measures  of  the  same  constructs.  In  three  as-yet  unpublished  studies,  associate 
degree  nursing  (ADN)  and  bachelor  of  science  in  nursing  (BSN)  faculties  that  use  HESI 
exams  provided  evidence  of  convergent  validity  for  these  exams  by  correlating  students’  HESI 
exam  scores  with  their  final  course  grades  and  cumulative  grade  point  averages  (GPAs).  The 
correlations  were  statistically  significant  (P  <  .0 1 .)  1 1 

This  study  compared  the  HESI  exam  scores  for  subjects  and  non-participants  in  all  four 
semesters  and  compared  the  grade  point  average  (GPA)  of  the  study  subjects  and  a  select  group 
(consented)  of  non-participants. 

Participants/Subject  recruitment 

Senior  nursing  students  in  their  final  semester  were  recruited  to  participate  during  their 
“capstone”  semester.  As  one  of  the  largest  schools  of  nursing  in  the  state,  we  had  access  to  over 
200  senior  students.  The  students  were  asked  to  participate  by  faculty  who  attended  a  class 
with  the  permission  of  their  instructor  to  brief  the  students  on  the  time  commitment,  logistics 
and  provided  them  with  a  written  consent  to  participate.  Of  the  students  who  were  asked  to 
participate,  54  participated  (80%  female,  20%  male)  over  the  four  semester  timeframe.  The 
ages  of  the  participants  ranged  from  20-30  (mean  SD  of  25  years).  Of  the  students  who  actually 
participated  50%  had  experienced  25%  of  the  clinical  hours  in  simulation  as  a  student  and  50% 
had  experienced  25%  of  the  clinical  hours  in  only  two  (2)  clinical  rotations  (pediatrics  and 
obstetrics) 


Institutional  Review  Board 
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An  application  for  protection  of  human  subjects  was  submitted  to  both  the  university  in 
which  the  subjects  were  students  and  the  Department  of  Defense,  the  organization  that  funded 
this  study.  Both  Institutional  Review  Boards  gave  permission  to  conduct  the  study.  All  of  the 
subjects  were  consented  using  the  term  “this  study  is  set  to  compare  here  different  simulation 
teaching  strategies”.  Thus,  the  dependent  variable  (medication  error)  was  not  revealed. 
Methodology 

Once  consented,  subjects  arrived  to  the  lab  with  no  prior  knowledge  of  the  experiment. 
The  lab  was  designed  to  keep  the  subjects  separate  utilizing  a  construction  method  with  exterior 
halls  and  soundproofed  simulation  rooms  Each  subject  spent  up  to  15  minutes  on  the  pretest.  15 
minutes  in  the  experiment  and  up  to  1 5  minutes  for  the  post  test. 

Subjects  were  randomized  to  all  three  experiments  in  a  crossover  design  with  a  one 
month  “washout”.  A  consensus  of  experts  agreed  on  a  one-month  washout  based  on  prior 
experience.  Each  of  the  four  semesters  included  one  cohort  of  subjects  who  were  only  tested  one 
time  in  a  controlled  experiment.  The  controls  were  each  of  the  three  simulation  strategies  and 
the  first  cohort  received  a  one-time  experience  in  one  of  the  three  experiments. 

Results 

Initial  analysis  showed  that  there  was  no  discernible  difference  in  performance  across 
semesters.  To  allow  for  more  statistically  meaningful  analysis,  groups  were  aggregated  across 
semesters  (Summer  2012,  Fall  2012,  Spring  2013)  based  on  treatment  order.  Table  1  shows  the 
treatment  order  for  each  group.  Table  2  shows  the  results  for  the  average  score  on  the  evaluation 
form  (or  virtual  reality  platform)  and  sample  size  n;  the  percent  that  committed  medical  error; 
and  the  percent  that  were  distracted  from  their  task;  and  the  weighted  average  for  each  treatment 
number  across  treatment  types.  There  were  no  distractions  for  the  virtual  reality  treatment. 
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Table  1:  Treatment  order  for  each  group 


Group 

1st  Treatment 

2nd  Treatment 

3rd  Treatment 

A  (control  group) 

B 

Standardized  patient 

Virtual  reality 

High  fidelity 

C 

Virtual  reality 

High  fidelity 

Standardized  patient 

D 

High  fidelity 

Standardized  patient 

Virtual  reality 

Table  2:  Results  for  each  group  and  each  treatment,  in  chronological  order 


Group 

Treatment  1 

Avg  %  %  Med 

Score  (n)  Error 

% 

Distracted 

Treatment  2 

Avg  %  %  Med 

Score  (n)  Error 

% 

Distracted 

Treatment  3 

Avg  %  %  Med 

Score  (n)  Error 

% 

Distracted 

B 

50%  (8) 

38% 

80%  (3) 

0% 

n/a 

C 

68%  (10) 

9% 

n/a 

33%  (6) 

83% 

17% 

61%  (9) 

33% 

33% 

D 

44%  (8) 

38% 

50%  (5) 

60% 

40% 

73%  (6) 

17% 

n/a 

Overall 

55%  (26) 

26% 

25% 

49%  (14) 

57% 

27% 

67%  (20) 

30% 

21% 

Despite  aggregation,  Treatment  2  has  fairly  small  sample  sizes,  making  it  difficult  to 
draw  conclusions;  the  relatively  small  samples  make  drawing  strong  conclusions  inadvisable. 


There  appears  to  be  either  no  change  or  an  improvement  in  participant  score  between 
treatments  1  and  3;  however,  there  may  be  an  increase  in  medical  error.  There  is  not  enough 
evidence  to  conclude  there  is  a  statistically  significant  difference  overall,  The  largest  apparent 
difference,  between  Group  D’s  first  and  third  treatment  scores,  falls  short  at  the  a  -  0.05  level 
(one-tailed  p  =  0.08).  We  will  use  the  a  =  0.05  significance  level  throughout  this  paper  unless 
otherwise  noted. 


Table  3  shows  the  results  for  each  group  and  each  treatment,  sorted  by  treatment. 


Table  3:  Results  for  each  group  and  each  treatment,  grouped  by  treatment 


Group 

Standardized  Patient 

Avg  %  %  Med  % 

Score  (n)  Error  Distracted 

Virtual Reality 

Avg  %  %  Med 

Score  (n)  Error 

% 

Distracted 

High  Fidelity 

Avg  %  %  Med 

Score  (n)  Error 

% 

Distracted 

B 

50%  (8) 

38% 

80%  (3) 

0% 

70%  (5) 

40% 

0% 

C 

61%  (9) 

33% 

33% 

68%  (10) 

9% 

33%  (6) 

83% 

17% 

D 

50%  (5) 

73%  (6) 

17% 

44%  (8) 

38% 

50% 

Overall 

umwm 

41% 

23% 

71%  (19) 

10% 

47%  (19) 

53% 

26% 
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The  largest  difference  in  average  score  is  between  high  fidelity  and  virtual  reality. 

The  hypothesis  that  the  average  score  for  virtual  reality  >  average  score  for  high  fidelity  is 
statistically  significance  with  the  one-tailed  p  =  0.026. 

Medical  error  appears  to  be  more  common  in  the  standardized  patient  and  high  fidelity 
environments  than  in  the  virtual  reality  environment.  Both  the  difference  between  virtual  reality 
and  standardized  patient;  and  between  virtual  reality  and  high  fidelity  are  statistically  significant, 
two-tailed  p  =  0.03  and  0.004,  respectively. 

Because  participant  results  for  specific  treatments  are  being  combined  across  treatment 
numbers,  the  comparisons  above  may  be  obscuring  actual  differences,  or  conflating  them  with 
other  factors.  We  next  examine  the  differences  in  treatments  using  the  control  groups  and  only 
observations  from  the  first  treatment  for  each  group. 

Table  4  summarizes  the  results  for  all  participants,  including  control  groups,  being 
exposed  to  a  treatment  for  the  first  time,  across  all  semesters. 


Table  4:  Results  for  each  treatment  across  control  groups  and  first  treatments  for  all 
groups,  across  all  semesters. 


Standardized  Patient 

Avg  %  %  Med  % 

Score  (n)  Error  Distracted 

Virtual  Reality 

Avg  %  %  Med  % 

Score  (n)  Error  Distracted 

High  Fidelity 

Avg  %  %  Med  % 

Score  (n)  Error  Distracted 

Overall 

50%  (13)  38%  31% 

71%  (18)  6% 

42%  (13)  46%  8% 

The  results  closely  mirror  those  in  Table  3,  which  compare  all  treatments  from  Groups 
B-D.  The  order  in  which  treatments  are  administered  seems  to  have  less  of  an  impact  than  the 
treatment  itself. 


The  difference  in  average  score  between  virtual  reality  and  high  fidelity  is  statistically 
significant,  two-tailed  p  =  0,04.  No  other  differences  in  scores  are  significant  (p  -  0.67  for 
standardized  patient  and  high  fidelity;  p  =  0. 13  for  standardized  patient  and  virtual  reality). 
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The  possible  difference  in  medical  error  between  standardized  patient  and  high  fidelity 
is  not  statistically  significant  {p  =  0.71).  The  difference  in  the  percent  distracted  between 
standardized  patient  and  high  fidelity'  is  also  not  statistically  significant  (/?  =  0.15). 

Overall,  25  instances  of  medical  error  occurred  across  a  total  74  observations. 


HESI 

There  is  no  statistically  significant  difference  between  HESI  scores  from  Spring  2012 
through  Summer  2013.  The  difference  in  score  between  the  highest  and  lowest  average  is  91 
points,  between  the  highest  and  lowest  medians  is  97  points,  on  a  scale  of  0  to  1600. 

The  following  areas  had  spreads  of  1 50  points  or  more.  It  was  not  possible  to  conduct 
significance  tests  on  the  individual  areas  because  of  lack  of  standard  deviations  in  the  summary 
data  provided. 

o  N1  -  Assessment  (A  =  178):  max  =  Spl2,  min  =  Spl3 
o  N3  -  Planning  (A  =  155):  max  =  Sul2,  min  =  Spl 3 
o  Cl  -  Safe  Environment  (A  =  150):  max  =  Sul2,  min  =  Fal2 
o  C2  —  Management  of  Care  ( A  =  1 70):  max  =  Su  1 2,  min  =  Sp  1 3 
o  C3  -  Safety  and  Infection  Control:  max  -  Sul 2,  min  =  Fa  12 
o  C4  -  Health  Promotion  &  Maintenance  (A  =  149):  max  =  Sul 3,  min  =  Spl 3 
o  CIO  -  Physio  Adaptation  (A  =  177):  max  =  Sul 3,  min  =  Sp  1 3 
Efficacy  of  treatment  type 

Of  the  three  treatments,  the  virtual  reality  scenario  had  the  lowest  incidence  of  medical 
error,  especially  compared  to  the  high  fidelity  simulation.  There  are  two  possible  explanations 
for  this.  The  first  is  that  the  current  generation  of  students,  the  Millennials,  is  very  comfortable 
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with  and  adept  at  technology,  which  inherently  leads  to  higher  performance.  Millennials  are 
defined  as  those  individuals  who  were  born  in  the  time  period  of  the  early  1980’s  to  the  early 
2000’s.  The  second  explanation  is  that  the  virtual  reality  simulation  requires  only  ordinary 
learning,  not  transference  of  content  and  skills  ,2’ 13 In  other  words,  participants  in  the  virtual 
reality  simulation  are  showing  “Understanding”  in  Bloom’s  Revised  Taxonomy,  whereas  the 
other  two  simulations  require  “Applying”  of  knowledge  and  skills  14 

Given  the  limited  sample  sizes,  it  is  not  possible  to  draw  strong  conclusions  about  the 
efficacy  of  high  fidelity  versus  standardized  patients.  Standardized  patient  scores  and  medical 
error  rates  are  higher  than  those  for  high  fidelity,  but  the  percent  distracted  are  lower. 

We  argue  that  virtual  reality  simulations  would  be  a  good  tool  during  earlier  education 
stages,  as  students  are  learning  fundamental  concepts.  After  they  have  achieved  understanding 
and  are  able  to  recognize  good  practice,  high  fidelity  or  standardized  patient  simulations  can  be 
employed  to  assist  in  knowledge  and  skill  transference  and  assessment. 

Efficacy  of  ordering  of  treatments 

As  outlined  in  Sections  x  and  y,  it  is  not  possible  to  discern  any  effects  of  the  ordering 
of  treatments.  It  may  be  that  sample  sizes  are  too  small  or  that  the  ordering  of  treatments  is  less 
important  than  the  actual  type  of  treatment,  as  discussed  in  the  previous  section. 
Limitations/Challenges 

Several  challenges  were  encountered  during  this  study.  Due  to  the  student’s  class 
schedule,  we  had  no-shows  on  occasion  and  even  after  attempting  to  contact  them  to  reschedule, 
we  met  resistance.  The  .  longitudinal  design  (three  experiment  times)  was  on  first  notion  a 
strong  design  as  each  subject  could  serve  as  their  own  control,  the  “drop  off’  rate  presented  a 
problem  of  statistical  power. 
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Discussion 

The  goal  of  this  study  was  to  examine  tiie  ability  to  recognize  an  embedded  medication 
error  in  three  types  of  simulation. 

Tables  1  and  2,  which  organizes  the  data  in  terms  of  the  cycle  of  treatment,  yields  little  to  no 
statistical  significance.  The  data  therefore  suggests  that  despite  completing  a  given  previous 
treatment,  the  nursing  students  performed  equally  well  in  their  next  treatment  in  comparison  to 
other  students  undergoing  the  same  treatment. 

Table  3  offers  more  statistical  evidence  that  virtual  platforms  produce  higher  average 
scores  than  both  high  fidelity  and  standardized  patient  treatments.  With  an  average  score  across 
all  three  groups  of  71%,  virtual  platforms  surpass  the  average  scores  of  55%  for  standardized 
patient  and  47%  for  high  fidelity.  Also,  medical  error  seems  to  be  the  lowest  with  virtual 
platforms  with  an  average  rating  of  10%,  while  high  fidelity  and  standardized  patient  treatments 
yielded  55%  and  47%  respectively.  In  general,  this  data  suggests  that  for  whatever  reason, 
students  performed  better  in  a  virtual,  instead  of  hands-on,  and  interpersonal  forum. 

Table  4  collates  the  control  groups,  which  were  randomized  to  a  single  treatment  and  not 
asked  to  return  for  following  treatments,  and  the  first  treatments  of  groups  B,  C  and  D.  Data 
shows  that  without  any  previous  exposure  and  no  proceeding  exposure  to  the  treatments, 
students  who  underwent  virtual  treatment  derived  a  higher  average  score  than  both  high  fidelity 
and  standardized  patient.  Virtual  treatments  also  yielded  considerably  lower  medical  error 
percentages.  This  suggests  with  the  given  student  demographic,  virtual  platforms  are  more 
conducive  for  current  students  than  both  high  fidelity'  and  standardized  patient  methods. 

A  reported  44,000  to  98,000  Americans  die  annually  as  a  result  of  medical  error 2  With 
this  knowledge,  if  s  imperative  to  not  only  continue  the  education  of  health  professionals,  but  to 
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also  encourage  active,  critical  discussion  of  today’s  educational  systems  in  healthcare.  It  is  clear 
from  the  data  presented  in  this  study  that  students  undergoing  what  is  considered  standard 
nursing  education,  are  presenting  low  capability'  in  scenarios  requiring  active  application  of  their 
knowledge  and  skills  (i.e.  Standardized  Patient  &  High  Fidelity). 

It  can  be  said  that  today’s  generation,  in  general,  has  a  markedly  distinct  upbringing  in 
the  age  of  technology,  Therefore,  we  can  expect  students’  performances  in  virtual  platforms,  as 
opposed  to  those  requiring  active  application,  to  be  better.  However,  healthcare  is  not  a  business 
of  passiveness,  but  a  business  of  active  practice,  So  the  question  must  be  asked  as  to  how  can 
today’s  healthcare  educational  system  confront  this  issue  presented  by  students  of  the  age  of 
technology.  As  this  study  shows,  although  limited  in  subjects  and  therefore  conclusions,  the  use 
of  progressive  methods  of  education,  such  as  high  fidelity  mannequins,  can  be  utilized  to  help 
reduce  medical  risk,  and  improve  future  healthcare. 

Conclusions 

Although  conclusions  point  towards  virtual/computer  based  simulation  as  being  the  best 
methodology  for  medication  error  recognition,  we  wonder  if  the  age  of  the  subjects  (~20  years) 
accounts  for  a  greater  comfort  with  technology  and  we  wonder  why  the  standardized  patients 
demonstrated  the  greatest  challenge  for  this  group  of  subjects.  In  a  careful  systematic  review  and 
meta-analysis  15  compared  technology-enhanced  simulation  versus  other  instructional  methods; 
they  concluded  that  standardized  patients  and  real  patients  had  similar  effects  for  all  outcomes 
except  process  measures  of  skills.  Since  the  accuracy  of  appropriate  dose  and  delivery  of 
medication  is  a  complicated  skill,  one  might  conclude  that  our  findings  are  congruent. 

Gaba  16  maintains  that  we  need  to  mobilize  larger  resources  to  provide  more  definitive 
answers  to  the  “big  questions  about  simulation”  (p.27).  We  are  grateful  to  the  Department  of 
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Defense  who  provided  important  resources  to  advance  our  understanding  of  how  different 
simulation  strategies  serve  to  educate  and  train  novice  learners. 
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